1 Value Surface

1.1 Estimated Value Function Using Normalized IPW

(#fig:unnamed-chunk-3)Estimated value of regime using normalized IPW

1.2 value Surface using MSM

(#fig:unnamed-chunk-4)Estimated value surface of regime using quadratic MSM and scatter plot of normalized IPW estimates.

2 Matern 5/2 GP Graphics

2.1 Interpolating GP

(#fig:unnamed-chunk-5)Estimated value of regime using interpolating GP after an additional 25 sampled points

2.2 Homoskedastic GP

(#fig:unnamed-chunk-6)Estimated value of regime using homoskedastic GP after an additional 25 sampled points

2.3 Heteroskedstic GP

(#fig:unnamed-chunk-7)Estimated value of regime using heteroskedastic GP after an additional 25 sampled points

3 Matern 3/2 GP Graphics

3.1 Interpolating GP

(#fig:unnamed-chunk-8)Estimated value of regime using interpolating GP after an additional 25 sampled points

3.2 Homoskedastic GP

(#fig:unnamed-chunk-9)Estimated value of regime using homoskedastic GP after an additional 25 sampled points

3.3 Heteroskedastic GP

(#fig:unnamed-chunk-10)Estimated value of regime using homoskedastic GP after an additional 25 sampled points